Fast algorithms for foveated video processing

This paper explores the problem of communicating high-quality, foveated video streams in real time. Foveated video exploits the nonuniform resolution of the human visual system by preferentially allocating bits according to proximity to assumed visual xation points, thus delivering perceptually high quality at greatly reduced bandwidths. Foveated video streams possess speci c data density properties that can be exploited to enhance the eÆciency of subsequent video processing. Here we exploit these properties to construct several eÆcient foveated video processing algorithms: foveation ltering(local bandwidth reduction), motion estimation, motion compensation, video rate control and video postprocessing. Our approach leads to enhanced computational eÆciency by interpreting nonuniform-density foveated images on the uniform domain and by using a foveation protocol between the encoder and the decoder.